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^ Abstract 

This  paper  reports  our  experiments  about  parallel  and 
sequential  implementations  for  combining  belief  func- 
tions with  an  application  to  a medical  diagnostic  system. 

We  use  as  a basis  existing  methods  for  combining  two 
belief  functions:  a direct  combination  based  on  Demp- 
ster’s rule  and  an  indirect  combination  through  Mobius 
transforms.  We  further  explore  various  parallel  algo- 
rithms for  combining  more  than  two  belief  functions, 
as  different  belief  functions  can  be  combined  in  any  or- 
der as  long  as  they  arc  independent  of  each  other.  Our 
results  indicate  that  for  the  general  case,  the  parallel 
implementation  based  on  fast  Mobius  transforms  proves 
to  be  the  most  efficient.  However,  for  practical  applica- 
tions where  most  subsets  of  a frame  of  hypotheses  have 
zero  probabilities,  tile  parallel  implementation  based  oil 
an  improved  direct  combination  rule  remains  the  moRt 
efficient.  _ ... 

1 Introduction 

This  paper  presents  parallel  and  sequential  algorithms 
for  combining  belief  functions.  The  Belief  Function 
approach  for  approximate  reasoning,  also  called  the 
Dcrnpstcr-Shafer  theory  [Shafer,  1976],  can  be  seen  as  a 
generalization  of  the  Probability  approach  [Pearl,  1988], 
since  probabilities  are  assigned  directly  to  subsets  of  a set 
of  mutually  exclusive  and  exhaustive  hypotheses  rather 
than  each  of  the  hypotheses. 

One  important  problem  for  the  application  of  the  DS- 
theory  is  the  efficiency  for  combining  the  belief  functions 
from  different  evidences.  Harnett  [1981]  proposed  a poly- 
nomial algorithm  which  only  applies  to  sets  of  single  hy- 
potheses or  singletons.  Work  by  ([Shafer  and  Logan, 
1987]  and  [Shafer  et  al. , 1987])  deals  with  extended  sub- 
sets that,  form  a hierarchical  structure.  More  recently, 
Kennes  and  Srnets  [l990l  apply  fast  Mobius  transforms 
to  reduce  redundant  computations  and  thus  improve  the 
efficiency  even  for  the  general  case. 

In  this  paper,  we  are  concerned  with  the  efficient  com- 
bination for  more  than  two  belief  functions.  We  use  as 
a basis  existing  methods  for  combining  two  belief  func- 
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tions:  a direct  combination  based  on  Dempster’s  rule  and 
an  indirect  combination  through  Mobius  transforms.  We 
further  explore  parallel  algorithms  for  combining  more 
than  two  belief  functions  in  order  to  improve  the  effi- 
ciency, as  different  pieces  of  evidence  can  be  combined 
in  any  order  aa  long  as  they  are  independent  of  each 
other. 

To  further  test  our  algorithms,  wo  consider  a medi- 
cal domain  that  involves  the  diagnosis  of  different  types 
of  canine  liver  diseases  (McLeish  et  al,  [1989],  [1990], 
[1991]).  This  is  a domain  on  which  doctors  have  diffi- 
culty predicting  precise  or  single  outcomes,  as  both  the 
numbers  of  possible  outcomes  (14)  and  available  tests 
(40)  are  quite  large.  In  terms  of  the  DS-theory,  this 
would  require  a combination  of  40  belief  functions  over  a 
frame  of  14  different  hypotheses1.  Although  our  parallel 
algorithms  can  largely  speed  up  the  implementation,  the 
amount  of  time  used  is  still  quite  long.  Fortunately,  for 
practical  applications,  especially  our  domain,  we  found 
that  most  of  the  subsets  have  zero  probabilities;  the  num- 
ber of  subsets  that  have  non-zero  probabilities,  called 
the  focal  elements,  arc  just  about  10  on  average.  Tims, 
special  versions  of  our  algorithms  can  be  designed  to  fa- 
cilitate the  practical  application.  Our  algorithms  are  all 
implemented  on  a Sequent  machine  using  the  parallel  C 
language  and  the  experimental  results  are  reported  later 
in  detail. 

2 Review  of  the  DS-theory 

In  DS-theory,  probabilities  are  assigned  directly  to  sub- 
sets of  a frame  of  hypotheses,  called  a mass  function 
(m).  Two  pieces  of  evidences  can  be  combined  using  the 
Dempster’s  rule,  where  rr»i  and  m-j  are  the  mass  func- 
tions for  the  given  evidences: 

“ £{"*i(fli)»»a(fla)  I Bl  n % J 1} 

The  rule,  os  stated  in  [Buchanan  and  Shortlife,  1984], 
provides  a way  of  narrowing  the  hypothesis  set  with  the 

1 See  [McLeish  and  Song,  1991]  for  the  genera!  framework 
of  our  expert  system  for  diagnosing  canine  liver  diseases. 


Combination  of  Belief  Functions  165 


accumulation  of  evidence  and  naturally  captures  the  pro- 
cess of  diagnostic  reasoning  in  medicine  and  expert  rea- 
soning in  general. 

There  are  two  ways  for  combining  mass  functions 
proposed  in  the  current  literature  ([Shafer,  1976]  and 
[Kennes  and  Smets,  1990]).  One  is  the  direct  combina- 
tion based  on  the  Demspter’s  rule,  for  which  it  can  be 
shown  that  the  following  theorem  holds: 

Thoorom  2.1  The  direct  implementation  of  the  Demp- 
ster’s rule  needs  (2n  - l)2  additions  and  2"(2n  - 1)  mul- 
tiplications. 

The  other  way  for  combining  mass  functions  is  the  in- 
direct combination  through  Mobius  transforms.  Based 
on  a mass  function,  a commonality  function  (Q)  is  fur- 
ther defined  in  [Shafer,  1976]: 

With  commonality  functions,  the  combination  of  differ- 
ent evidences  is  reduced  to  the  multiplication  of  the  com- 
monality functions, 

Q(A)  = A’Qi(A)...Qn(A) 

where  A'-1  is  a constant  that  does  not  depend  on  A. 

A Mobius  transform  is  a function  defined  over  a 
partially  ordered  set.  For  example,  the  computations 
front  rn  to  Q and  vice  versa  are  all  Mobius  transforms. 
The  idea  of  a fast  Mobius  transform  is  to  decompose 
the  whole  transform  into  a series  of  simple  transforms 
[Kennes  and  Smets,  1990],  In  each  step,  as  illustrated 
in  figure  1,  we  only  consider  one  hypothesis  and  its  re- 
lated transform.  For  example,  the  first  step  will  achieve 
the  transform:  {(A’,  Y)  | X f 0 and  (T  =2  X or  Y = 
HU(c})J,  where  X and  Y are  two  subsets  of  0.  Then, 
by  recursively  doing  this  for  all  the  hypotheses,  we  will 
be  able  to  transform  from  one  function  to  another  func- 
tion. 


(mi,  m2) 


mi  ® m2 


m 


mtoq 


qtom 


| Q\*Qt  j 

Figure  2:  Combination  through  Mobius  Transform 


Lemma  2.1  Suppose  m and  Q are  two  functions  defined 
over  a frame  0,  then  we  have: 

Q(A)=  £ m(B)  iffm(A)  = £ 

B?A  D3A 

Based  on  the  above  lemma,  we  can  now  construct  a fast 
Mobius  transform  from  Q to  m.  It  is  the  same  as  the 
transform  from  m to  Q except  that  all  the  links  have 
weighting  factor  (—1)  (see  [Kennes  and  Smets,  1990]  for 
detailed  discussions). 

Theorem  2.2  The  indirect  implementation  of  Demp- 
ster's rule  through  Mobius  transforms  needs  3n2""1  ad- 
ditions and  2n+I  multiplications. 

3 Algorithms  for  Combining  Belief 
Functions 

In  this  section,  we  consider  how  to  combine  r pieces  of 
evidence  efficiently,  with  r > 2.  In  particular,  we  present 
three  pairs  of  algorithms  for  combining  r mass  functions: 
sequential,  parallel,  and  practical  methods. 


{ } {»}  {b}  {a.b}  {c}  {a,c}  {b,c}  {a,b,c} 


Figure  1:  Diagram  for  the  Transform:  m — *■  Q 

To  combine  mass  functions,  we  follow  the  path  from 
{rn,  } to  {Q,}  to  Q to  m,  as  shown  in  figure  2.  However, 
although  the  transform  from  Q to  m is  not  provided 
in  [Shafer,  1976],  it  can  be  proved,  following  a similar 
approach,  that  the  following  lemma  holds. 


3.1  Sequential  Combination  Methods 

Based  on  the  two  methods  introduced  earlier,  we  can 
provide  two  sequential  algorithms  for  combining  more 
than  two  belief  functions.  A sequential  algorithm  based 
on  Dempster's  rule  can  be  given  as  follows: 

algorithm  3.1  sequential  fc  direct  implementation 
input  m[l  : r] [0  : 2n  - 1],  r bodies  of  mass  functions, 
and  n,  the  cardinality  of  the  frame 
output  m[l][0  : 2n  - 1],  the  combined  mass  function 
begin 

for  i = 2 stop  l until  r do 
comb-two(m[l],  m[i]) 
endfor 

end 

Here,  we  use  a n-digit  binary  number  to  represent  a 
frame  of  size  »,  and  for  each  subset,  the  tth  element 
is  1 if  the  corresponding  element  is  in  the  subset.  Also, 
“comb-two”  is  a procedure  for  combining  two  mass  func- 
tions. 
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Corolary  3.1  Algorithm  3.1  needs  (r—  l)(2n  — l)2  ad- 
ditions and  (r  - l)2”(2n  — 1)  multiplications. 

Another  way  of  implementing  the  Dempster’s  rule 
is  to  compute  the  combined  mass  function  indirectly 
through  Mobius  transforms.  A sequential  algorithm  for 
this  method  can  be  given  as  follows: 

algorithm  3.2  sequential  k indirect  implementation 
begin 

for  i = 1 stop  1 until  r do 
mtoq(m[t]) 
endfor 

for  i = 0 stop  1 until  2n  — 1 do 
for  j = 2 stop  1 until  r do 
m[l][i]  <-  m[l][»]  + m[>][t] 
endfor 
endfor 

qtoin(m[l]) 

end 

Corolary  3.2  Algorithm  S.S  needs  n(r  + 1)2"-1  addi- 
tions and  r2"  multiplications. 

3.2  Parallel  Combination  Methods 

Since  in  DS-theory,  different  pieces  of  evidence  can  be 
combined  in  any  order  as  long  as  they  are  independent 
of  each  other,  we  can  further  explore  parallel  algorithms 
for  the  combination  of  more  than  two  belief  functions. 

algorithm  3.3  parallel  k direct  implementation 
bogin 

while  r > 1 do 
r'  = r/2 

for  >'  = 1 stop  1 until  r'  do  in  parallel 

comb"two(m[f],  m[r'  + i]) 
endfor 

if  odd(r)  then 

m[r'  4- 1]  = m[r];  r = r'  4 1 
else  r •=  r' 
endvvhile 
end 

Corolary  3.3  Algorithm  3.3  needs  [log r](2"  -- l)2  addi- 
tions and  (log  rj2n (2"  — 1)  multiplications,  where  [log  r] 
stands  for  the  smallest  integer  that  is  greater  or  equal  to 
log  r. 

algorithm  3.1  parallel  k indirect  implementation 
begin 

for  i — 1 step  i until  r do  in  parallel 
mtoq(r»[i]) 
endfor 

for  i = 0 step  1 until  2"  - 1 do  in  parallel 
for  j = 2 stop  1 until  r do 
mrl](j]  m[  1 J [»]  * m[j](i] 

endfor 
endfor 


qtom(m[l]) 

end 

Corolary  3.4  Algorithm  3. 4 needs  n2"  additions  and 
2"  4 r multiplications. 

3.3  Practical  Combination  Methods 

To  further  test  our  algorithms,  we  choose  a medical  do- 
main that,  involves  the  diagnosis  of  canine  liver  diseases. 
We  found  that  for  such  a domain,  most  of  the  mass  func- 
tions only  have  a small  number  of  non-zero  subsets,  or 
focal  elements.  Although  the  above  algorithms  work  for 
general  cases,  for  practical  reasons,  we  must  revise  them 
to  facilitate  the  almost  null  distribution  of  mass  func- 
tions. 

In  the  following  we  first  provide  a revised  procedure 
for  direct  combination  based  on  Dempster’s  rule. 

function  comb-two'(mi , mj,  L i , La) 
begin 

for  i = 1 step  1 until  Li  do 
for  j — 1 step  1 until  La  do 
s *-  s t [i]  k sat/j 
m[s]  ♦-  m[«]  4 mi  [j]  * m3  [j] 
endfor 
endfor 
A'  <—  1 - m[0] 

for  i = 1 step  1 until  2"  - 1 do 
if  m[i]  > 0 tlion 
L •—  L 4 1 

«i[L]  — i\  mi[L]  m[i]/A‘ 
endif 
endfor 
return  L 

end 

Here,  is  tlio  bitwise  operator  for  the  logical  opera- 
tion "AND”,  corresponding  to  the  intersection  operation 
between  two  subsets. 

Then  a parallel  algorithm  for  combining  more  than 
two  mass  functions  can  be  designed  as  follows: 

algorithm  3.5  practical  par.  k dir.  implementation 
begin 

while  r > 1 do 

r/2  . 

„.,r  i = 1 step  1 until  r'  do  in  parallel 
L[i] «—  comb-two'(m[j],  m[r'  4 i],  L[i],  L[r'  4 <]) 
end  l or 
ifodd(r)  tlion 
m[r'  4 1]  *—  m[r);  r *—  r'  4 1 
else  r *—  r1 
ondwliile 
end 

To  see  how  speed  can  be  gained  for  the  above  algo- 
rithm, let  us  consider  our  domain  of  canine  liver  dis- 
rwss.  For  a frame  of  size  14,  21'1  gives  us  16,384,  Thus, 
the  direct  combination  of  two  mass  functions  would  re- 
quire (21*  — l)"2  additions  and  214(2H- 1)  multiplications. 
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However,  the  above  improved  direct  combination  would 
only  need  about  100  additions  and  110  multiplications, 
ns  the  average  number  of  focal  elements  is  10  for  any 
mass  functions  in  our  domain  (see  [McLeish  and  Song, 
1091]  for  different  methods  of  extracting  mass  functions 
from  medical  data  collected  over  time). 

Similarly,  we  can  add  a testing  statement  in  a Mobius 
transform  and  only  perform  an  addition  when  the  new 
element  is  non-zero,  Since  the  cost  of  a testing  statement 
is  usually  less  than  an  arithmetic,  operation,  we  would 
expect  some  saving  of  time  when  most  of  the  subsets 
have  zero  probabilities.  The  modified  algorithm  based 
on  the  Mobius  transforms  will  be  called  algorithm  3.6  in 
our  experiments. 

4 Experimental  Results 

Our  algorithms  are  all  implemented  on  a Sequent  Sym- 
metry machine  using  the  Parallel  C language  [Osterhaug, 
1989).  A Sequent  machine  has  an  architecture  of  truly 
multiple  processors  and  a shared  memory,  all  connected 
through  a system  bus.  This  provides  a way  for  increasing 
the  accessibility  of  data  and  minimizing  the  communica- 
tion cost , As  a result,  we  can  actually  run  our  algorithms 
on  this  machine  and  observe  the  improvement,  of  speed 
for  a problem  of  reasonable  size. 

In  our  experiments,  we  run  our  algorithms  on  a ma- 
chine of  ten  processors.  Our  results  can  further  be  im- 
proved when  more  processors  are  available,  say  16  or 
32,  which  become  more  and  more  common  for  Sequent 
machines.  Although  our  system  is  not  large,  it  already 
shows  the  potential  of  using  parallel  algorithms  for  effi- 
ciently combining  belief  functions. 


# Mass 

Alg3.2 

Alg3.4 

Algo.  6 

Alg3.6 

02 

13.26 

9.18 

0.43 

7.56 

03 

17.71 

9.25 

0.95 

7.59 

04 

22.19 

9.31 

0.95 

7.72 

05 

26.74 

9.37 

1.51 

7.76 

08 

40.22 

13.88 

1.49 

11.30 

10 

49.19 

14.00 

2.04 

11.46 

15 

71,68 

18.65 

2.35 

15.15 

16 

76.21 

23.01 

2.34 

18.65 

20 

94.21 

23.30 

2.88 

18.86 

25 

117.4(1 

27.93 

3.52 

22.57 

30 

140.49 

32.60 

3.54 

26.29 

32 

149.74 

37.03 

3.80 

29.70 

35 

164.69 

37.20 

4.39 

30.01 

40 

188.18 

41,84 

4.39 

33.07 

Table  1:  Results  of  Sequential  and  Parallel  Experiments 

As  our  results  illustrate,  for  the  general  case,  the  par- 
allel implementation  based  on  the  fast  Mobius  trans- 
forms (algorithm  3.4)  is  the  most  efficient.  However,  for 
many  real  applications  where  most  of  the  subsets  have 
zero  masses,  the  parallel  implementation  based  on  the 


improved  direct  combination  (algorithm  3.5)  is  still  the 
most  efficient2. 

Further  work  is  being  carried  out  to  minimize  redun- 
dant computations  in  a Mobius  transform  and  explore 
parallelism  in  Dempster’s  rule.  Methods  working  with 
continuous  data  are  also  being  investigated  with  an  ap- 
plication to  our  domain  of  liver  disease  diagnosis. 
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